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(54) Title: OBSTRUCTION DETECTION SYSTEM 

(57) Abstract 

The invention provides for a method of detecting 
objects in an area, the method including obtaining one 
or more images of the area, using an edge detection 
technique in such a way as to highlight substantially 
dominant linear features in the image(s), and deter- 
mining if any dominant linear features intersect linear 
features defining the area. The method may also in- 
clude detecting parallax in at least two images, the 
parallax being produced by the presence of 3-dimen- 
sional objects in the area. 
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6. 



A method of detecting objects in an area, the method including obtaining one 
or more images of the area, using an edge detection technique in such a way 
as to highlight substantially dominant linear features in the image(s), and 
determining if any dominant linear features intersect linear features defining 
the area. 

A method of detecting objects in an area as claimed in claim 1 wherein the 
area is an object detection zone, the area being separated into at least two 
zones; a primary zone, being the volume described by a door and a door sill; 
and a secondary zone, which may include the volume beyond the door 
through which a person using the door would pass. 

A method of detecting objects in an area as claimed in claim 2 wherein 
primary zone is the door(s) and sill of an elevator and secondary zone is the 
landing/lobby where passengers may wait for the elevator. 

A method of detecting objects in an area as claimed in any one of claims 1 to 
3 wherein there are at least two images and the method includes a further 
step of detecting parallax in the two or more images, the parallax being 
produced by the presence of an object in the area, more specifically in the 
secondary zone. 

A method of detecting objects in an area defined by a door and/or sill, said 
method including using edge detection techniques in such a way so as to 
highlight the substantially dominant linear features in an image or image(s), 
and determining if any dominant linear features intersect linear features 
defining said door and/or sill. 

A method of detecting objects in an area as claimed in claim 5 wherein the 
method includes a preliminary stage of characterising one or more images to 
establish the presence of any characteristic linear features in the area, said 
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characteristic linear features are lines defining the door edges and/or sill and 
the location of said features is stored for future reference. 

7. A method of detecting objects in an area as claimed in claim 5 wherein the 
method also includes an operational stage which analyses one or more images 
to establish the presence of any uncharacteristic features in the volume, said 
uncharacteristic features representing potential object and/or obstructions in 
the area. 

8. A method of detecting objects in an area as claimed in claims 6 or 7 wherein 
the preliminary stage includes at least two steps, a first step of detecting the 
location and dimensions of a door sill and a second step of detecting the 
location and dimensions of one or more door edge(s). 

9. A method of detecting objects in an area as claimed in claim 8 wherein the 
first step includes: 

using substantially horizontal and/or substantially vertical edge 
detection filters to highlight the dominant vertical and/or horizontal 
lines in the part of the image where the sill is known to be 
approximately located; summing the intensity values along each row of 
pixels in the image(s) produced using the vertical and/or horizontal edge 
detection filters thus producing a vertical and/or horizontal function 
with maxima and/or minima corresponding to the position of horizontal 
linear features and/or vertical linear features, said linear features 
defining the spatial location of the door sill in terms of horizontal and 
vertical features in the image. 

10. A method of detecting objects in an area as claimed in claim 8 or claim 9 
wherein the second step includes: 

using knowledge of the spatial location of the sill and knowledge of the 
physical relationship between the sill and the door edge(s) to obtain a 
sub-image or sub-images of the door(s); 
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subjecting the sub-image(s) to edge detection filters adapted to 
highlight edges oriented at angles which lie between some known 
bounds; 

manipulating the sub-image(s) to produce a binary image(s), the binary 
image(s) consisting of one of more linear features corresponding to the 
door edges; and 

deriving equations for the linear features in the binary image(s). 

11. A method of detecting objects in an area as claimed in claim 10 wherein the 
known bounds are substantially vertical and substantially horizontal edges. 

12. A method of detecting objects in an area as claimed in claim 10 or 1 1 wherein 
prior to deriving equations for the linear features in the binary image(s) the 
second step may also include: 

manipulating the binary image by a ramp function which increases in 
magnitude in the vertical direction; 

further manipulating the images to clearly identify any dominant linear 
features in the binary image(s), the manipulation including applying a 
first filter to remove any substantially isolated features in the binary 
image(s), and applying a second filter to the binary image(s) to thin any 
substantially linear features in the image(s). 

13. A method of detecting objects in an area as claimed in any one of claims 10 
to 1 2 wherein the equations of the linear features are obtained by locating the 
line(s) by means of a least squares, or similar, technique; if there is more than 
one dominant linear feature in the image(s), once the equation for any one 
linear feature has been determined, that linear feature is removed from the 
image and the next dominant linear feature equated. 

14. A method of detecting objects in an area as claimed in any one of claims 10 
to 1 3 wherein a total weighting means is used to manipulate an estimate of 
the equation for each linear feature, thereby improving the confidence of the 
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equation for that linear feature, the total weighting means being found by 

normalising, and if necessary multiplying, one or more of: 

a first weighting means, wherein the derivative and variance of a linear 
feature are determined, changes in the derivative and distance of points 
of the feature which are outside a given parameter representing breaks 
in the feature, the first weighting means down weighting or eliminating 
said points from the estimate; and/or 

a second weighting means, wherein points in a linear feature further 
away from the image capture source are given a higher weighting than 
points in the same feature which are closer to the image capture 
source; and/or 

a third weighting means, wherein the third weighting means is the 
inverse of the derivative of the feature; and/or 

a fourth weighting means, wherein linear features which do not span 
any sub-image from vertical edge to vertical edge are weighted.. 

15. A method of detecting objects in an area as claimed in any preceding claim 
wherein the edge detection may be effected by means of filters, differentiators 
and the like. 

16. A method of detecting objects in an area as claimed in any preceding claim 
wherein said edge detection is aimed at highlighting dominant lines orientated 
substantially horizontal, vertical and substantially diagonal, more particularly 
the diagonal lines are at substantially 45° and 135°, in the image(s). 

17. A method of detecting objects in an area as claimed in claim 7 wherein the 
operational stage includes the steps of: 

capturing one or more real time operational images of the area; 
detecting the position of a door or doors in the image(s); 
detecting the presence of objects in the area of the image(s) 
representing a sill; and 

detecting the presence of objects in the area of the image(s) 
representing the door edges. 
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18. A method of detecting objects in an area as claimed in claim 17 wherein the 
position of the doors is obtained by detecting the intensity change in the 
substantially horizontal features of the sill where the intensity changes define 
the spatial location of the door(s) in the image(s). 

19. A method of detecting objects in an area as claimed in claim 17 wherein the 
presence of objects in the area of the image representing the sill is determined 
by at least using a substantially vertical edge detection filter to highlight 
predominately vertical features in the image which intersect the linear features 
of the sill. 

20. A method of detecting objects in an area as claimed in claim 17 wherein the 
presence of objects in the area of the image representing the door edges is 
determined by at least using an edge detection filter to highlight predominate 
features in the image which intersect the linear features of the door. 

21. A method of detecting objects in an area as claimed in any one of claims 17 
to 20 wherein the operational step includes converting the edge detected 
image(s) to a histogram or histograms wherein peaks in the histograms 
represent features in the image(s), said features representing the door(s) 
and/or sill, and/or an obstruction or obstructions on the door edge(s) and/or 
sill. 

22. A method of detecting objects in an area as claimed in any one of clams 17 to 
21 wherein the operational stage may be repeated a plurality of times. 

23. A method of detecting objects and/or movement in objects, the method 
including the step of detecting parallax in two or more images of an area, the 
parallax produced by the presence of an object in the area. 



24. 



A method as claimed in claim 23 the method including the step of detecting 
temporal changes in the images of the area. 
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25. A method as claimed in claim 23 and 24 wherein the method includes the 
step of detecting vertical and horizontal parallax produced by an object located 
in the area. 

26. A method as claimed in claim 25 including the steps of aligning backgrounds 
of a plurality of images of an area and subtracting pairs of images so as to 
reveal, by way of parallax, the presence of objects in the area. 

27. A method as claimed in claim 23 or claim 26 wherein the method of detecting 
objects includes the steps of aligning backgrounds of a first and second image 
of an area and subtracting the first image from the second, thereby revealing, 
by way of parallax, the presence of a three dimensional object. 

28. A method as claimed in claim 23, 26 or 27 wherein the method includes the 
steps of: 

collecting a first image of an area from a first viewing point; 
collecting a second image of an area from a second viewing point; 
calculating the shift between the backgrounds of the two images; 
aligning the backgrounds of the two images; 
subtracting the two images to produce a third difference image; 
analysing the third difference image to detect parallax thereby revealing 
the presence of a 3-dimensional object in the area. 

29. A method as claimed in claim 28 wherein following the subtraction step, and 
before the analysing step, there is a thresholding step whereby the difference 
image is thresholded to exclude noise thus producing a binary image. 

30. A method as claimed in claims 28 or 29 wherein the third difference image is 
manipulated so as to contain substantially only the outlines of any 3- 
dimensional objects in the area. 
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31. A method as claimed in any one of claims 28 to 30 wherein the images are 
divided into background images and door edge images wherein calculation of 
the necessary shift between the backgrounds of the two images is based on 
the images of the background when no object is present. 

32. A method as claimed in any one of claims 28 to 31 wherein the shift is 
calculated using cross-correlation. 

33. A method as claimed in any one of claims 28 to 32 wherein the images are 
blurred with gaussian, median or similar filters so as to reduce the effect of 
pixelation in the images. 

34. An apparatus for detecting objects in an area, said apparatus including at least 
one imaging means and a microprocessor apparatus adapted to carry out the 
method as claimed in any preceding claim. 

35. An apparatus for detecting objects in an area, the apparatus including: 

at least one imaging means adapted to image the same scene from at 
least two spatially separate viewing points; and 

microprocessor apparatus adapted to manipulate said images in such a 
way as to highlight substantially dominant linear features in said 
images and determine if any dominant linear features signify the 
presence of an object in the area. 

36. An apparatus for detecting objects in an area, the apparatus including: 

at least one imaging means adapted to image substantially the same 
scene from at least two spatially separate viewing points; and 
microprocessor apparatus adapted to manipulate said images in order 
to calculate the shift between the backgrounds of the two images or 
pairs of images, align the background images based on said shift, 
subtract the resulting images to produce a difference image thereby 
allowing the detection of parallax effects in the difference image thus 
signifying the presence of an object in the area. 
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37. An apparatus for detecting objects in an area as claimed in claim 34 to 36 
wherein the microprocessor is also adapted to manipulate the image or images 
to highlight substantially dominant linear features of the image(s). 

38. An apparatus for detecting objects in an area as claimed in any one of claims 
34 to 37 wherein the images may be manipulated optically, mathematically or 
in a like manner which reveals dominant linear features and/or parallax in the 
image(s) of the area. 

39. An apparatus for detecting objects in an area as claimed in any one of claims 
34 to 38 wherein the microprocessor is further adapted to threshold the 
image(s). 

40. An apparatus for detecting objects in an area as claimed in any one of claims 

33 to 39 wherein the microprocessor may be in the form of a solid state, 
optical or the like device. 

41 . An apparatus for detecting objects in an area as claimed in any one of claims 

34 to 40 wherein a single camera is used and the apparatus includes an 
optical arm and reflection means adapted to relay an image from a viewing 
point that is displaced from the physical location of the camera. 

42. An apparatus for detecting objects in an area as claimed in any one of claims 
34 to 41 wherein the collection of two or more images may be effected by 
optical means including prisms, coherent optical fibre guides, and the like or 
alternatively the imaging means themselves may be translated or suitably 
displaced. 

43. An apparatus for detecting objects in an area as claimed in any one of claims 
34 to 42 wherein there may be artificial features added to aid the 
microprocessor in highlighting substantially normal dominant features of the 
image(s). 
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44. An apparatus for detecting objects in an area as claimed in any one of claims 
34 to 42 wherein there may also be an input means, the input means enabling 
a user to input the location of normal dominant features into the 
microprocessor. 
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citations and explanations supporting such statement 



Date of submission of the demand 
7 September 2000 


Date of completion of the report 
20 March 2001 


Name and mailing address of the IPEA/AU 

AUSTRALIAN PATENT OFFICE 
PO BOX 200, WODEN ACT 2606, AUSTRALIA 
E-mail address: pct@ipaustraliagov.au 
Facsimile No. (02) 6285 3929 


Authorized Officer 
D.G. FRY 

Telephone No. (02) 6283 2130 
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tional application No. 
/NZ00/00013 



I. 



Basis of the report 



With regard to the elements of the international application:* 
[xl the international application as originally filed. 



the description, 


pages 


* 


as originally filed, 




pages 




filed with the demand, 




pages 


9 


received on with the letter of 


the claims, 


pages 


9 


as originally filed, 




pages 


9 


as amended (together with any statement) under Article 19, 




pages 


9 


filed with the demand, 




pages 


9 


received on with the letter of 


the drawings, 


pages 


9 


as originally filed, 




pages 


9 


filed with the demand, 




pages 


9 


received on with the letter of 



| I the sequence listing part of the description: 

pages , as originally filed 
pages 
pages 



filed with the demand 
received on with the letter of 



With regard to the language, all the elements marked above were available or furnished to this Authority in the language in 
which the international application was filed, unless otherwise indicated under this item. 
These elements were available or furnished to this Authority in the following language which is: 
| | the language of a translation furnished for the purposes of international search (under Rule 23. 1(b)). 

| | the language of publication of the international application (under Rule 48.3(b)). 

I I the language of the translation furnished for the purposes of international prelirninary examination (under Rules 55.2 
and/or 55.3). 

With regard to any nucleotide and/or amino acid sequence disclosed in the international application, was on the basis of the 
sequence listing: 

| | contained in the international application in written form. 

| | filed together with the international application in computer readable form. 

| | furnished subsequently to this Authority in written form. 

| | furnished subsequently to this Authority in computer readable form. 

| | The statement that the subsequently furnished written sequence listing does not go beyond the disclosure in the 

international application as filed has been furnished. 
| | The statement that the information recorded in computer readable form is identical to the written sequence listing has 

been furnished 

| | The amendments have resulted in the cancellation of: 

| | the description, pages 

| | the claims, Nos. 

| | the drawings, sheets/fig. 

| | This report has been established as if (some of) the amendments had not been made, since they have been considered to 
go beyond the disclosure as filed, as indicated in the Supplemental Box (Rule 70.2(c)).** 

Replacement sheets which have been furnished to the receiving Office in response to an invitation under Article 14 are referred to in this 
report as "originally filed" and are not annexed to this report since they do not contain amendments (Rules 70. 1 6 and 70,17). 

Any replacement sheet containing such amendments must be referred to under item I and annexed to this report 
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Lack of unity of invention 




1. 


In response to the invitation to restrict or pay additional fees the applicant has: 

| | restricted the claims. 

| | paid additional fees. 

| | paid additional fees under protest. 

| [ neither restricted nor paid additional fees. 




2. 


[ [ This Authority found that the requirement of unity of invention is not complied with and chose, according to Rule 
68.1, not to invite the applicant to restrict or pay additional fees. 


3. 


This Authority considers that the requirement of unity of invention in accordance with Rules 13.1, 13.2 and 13.3 is 




| | complied with. 






|~X] not complied with for the following reasons: 






Claims 1 and 35 define a method and apparatus which determines if dominant linear features 
intersect linear features defining the area. Claims 23 and 36 define the step of detecting parallax in 
two or more images of an area. There is no common special technical feature between these claims. 
The specification at page 40 lines 8-15 indicates such features are different. 




Thus the application is not directed to one invention only. 




4. 


Consequently, the following parts of the international application were the subject of international preliminary 
examination in establishing this report: 




fx] all parts. 






[ | the parts relating to claims Nos. 
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V. Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; citations 

and explanations supporting such statement 



1 . Statement 



Novelty (N) 


Claims 


1-44 


YES 




Claims 




NO 


Inventive step (IS) 


Claims 


1-44 


YES 




Claims 




NO 


Industrial applicability (IA) 


Claims 


1-44 


YES 




Claims 




NO 



2. Citations and explanations (Rule 70.7) 

NOVELTY CN) 
INVENTIVE STEP (IS) 

US 5387768 
US 5182776 
DE 19522760 

These citations of the Search Report are "A" category documents only, which disclose the general state of 
the art. 

The first two documents are discussed at pages 2 and 3 of the present specification. 

Specifically there is no disclosure in these documents, either individually or in any obvious combination, of 
the method of detecting objects by determining if any dominant linear features intersect linear features 
defining the area as set out in Claims 1 and 35, or the method of detecting parallax in two or more images 
of an area as set out in Claims 23 and 36. 

Thus, the invention satisfies the requirements for novelty and inventive step. 
INDUSTRIAL APPLICABILITY 

The invention set out in the claims of this application satisfies the requirements for this criteria. 
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